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ABSTRACT 

The primary objective of' The College Discovery and 
Development Program (CDD) , funded under the -Elementary Secondary 
Education Act Title I, has been the discovery.; and development of the 
college potential of high school youth who are academically and 
financially disadvantaged. This program wa^ designed to improve tl^e 
reading and mathematics performance of the students in the target 
population. The program began in September 1975 at three Title I high 
schools. Participating students were enrolled in the tenth, eleventh 
and twelfth grades. The 748 students who were at least two years 
retarded in reading and mathematics entered the program. Pre and .post 
tests, on site observations and visits provided evidence that the 
proposed program was implemented as planned. (Author/JH) 
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OHAP'XHni I 
TKxi P.tOGRAl'i 

The College Discovery and Development Program (CDD) 
has been, operating vrith the joint sponsorship of the City 
University of I-iew York and the Kew York City Board of Education 
for eleven years (1965-19/6) • Its major objective has become 
the discovery and development of the college potential of high 
school youth who are acadenically and f^na:^cially disadvantaged • 

The approach involves both identifying the special 
nature of these students' educational requirements and provid- 
ing intensive educational support during their time in the 
CDD program. The intent of this approach is viev?ed as one of 
increasing the likelihood of the students entering College. 

The project's reading and mathematics components, 
funded by Title I ESEA, were supplementary to services and 
instruction under City tax level funds. These components have 
a remedial and/or corrective focus in the current programs. 

Objectivest /i}he program was designed to demonstrate 
increments that shov: statistically significant difference in 
the readirjg and mathematics performances of those students who 
comprised the target population. It was operative during the 
period of September 1975 to June 1976 at^three Title i high ~ 

schools, one in each of three boroughs i Theodore Roosevelt^ 

High. School in the Bronx, Thomas Jefferson High School in 
Brooklyn and Seward Park High School in Maonhattan^ The students 
vfho participated in the ODD program were enrolled at three 
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grade levels 10th» 11th, and 12th, having been admitted in 
September 1973 f 197^, and 1975 respectively. According to the 
project proposal the enrollment of the three grades at the 
three schools was to total 812. The actual niimber of students 
on "^he rolls was approximately 800, / 'However, students whose 
names were listed but for whom test data were not available 
at either pre and post testing or at pre testing, were not 
entered into the analyses. The total number of participants 
was 7^8 and included those students for whom at least a pre- 
test score in either the reading or mathematics component was 
available . 

To achieve the objectives of the program small g^^up 
instruction v^as used to provide remediation and correction for 
classes of from 15 to 20 pupils each. Students were provided 
five, ^0 minute periods a week of supplementary instruction in 
either or both the reading and mathematics component in addition 
to their regular classes. The program was designed to assist 
students W: identifying and overcoming difficulties in the axe^^'-- 
of the respective components. In the reading program word 
attack and comprehension skills necessary for meaningful read- 
ing were addressed. The mathematics component focused on over- 
coming basic skill deficiencies. Students also participated in 
the regular " jrchool curricul-um. 

The nature of the criterion for participation in the 
GDD program is a major leterminant of the need for remedial 
practices. Initial selection of students for the GDD program 



has been based on socio-economic and academic criterion 
applied to 9th graders who are viewed as the "potentially able 
from among the disadvantaged" to academically benefit from a 
"Special program of studies, guidance, enrichment and tutor- 
ing."*^ Nominations are solicited from among those students, 
"who, In spite of potential, would most likely not achieve 
college entrance without special assistance by the school 
because of difficulties assumed to be the result of social and/ 
or economic disadvantage."*^ Forms providing the requested 
Information are "completed by the school counselor In consul - 
tation with teachers and with the approval of the principal, "^ 
and by the candidate . 

The "Personal Information Form" and "Nominating Form" 
Include such socio-economic variables as "ethnicity, family 
structure, living conditions; economic data, employment and 
education of parents."^ Among the academic variables included 
in the forms werej "7th, 0th, and mid-year 9th grade general 
averages, and the Metropolitan Achievement Test Reading and 
Mathematics scores."^ 

The above represent some of the variables used by 
City University personnel in screening for eligibility among 
9th year students, at New York City junior and senior high 
schools. Applications of those who are identified as eligible 
applicants for the College Development Centers" are then 
revievred by a panel of staff members from each of the Centers, 
The staff selected and enrolled approximately 375 9th yeax 
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educationally and economically disadvantaged students. These 
students entered the program in the 10th year. 

The Program Proposal and ^ivaluatlon Design do not 
Spell out the degree of deficit in reading and in mathematics 
requlr^.d for entry nor do they specify the criteria for 
initial student selection for the program. However, it is 
understood that a deficit of two years retardation is required • 
To be eligible the pupil must be educationally and economically 
deprived. This information \o spelled out in recruitment 
material along with the criteria for initial student selection. 
The material is sent to feeder schools, principals, guidance 
counselors, community agencies and to selection committees. 



^GDD Program domination Form 

.U .N .Y* "Discovering and Developing the College potential of 
iiis advantaged High School Youth," pg. 55$ harch 1975. " 



8 



CHAPTER II 
EVALUATIVE PHOCEDUBES 



Objectives of the Evaluation 

The purpose of the evaluation was to provide a 
description of the effect of participation In small group 
Instruction on reading and mathematics grades of the targeted 
students • 

Evaluation Objective No, 1 "To determine whether, 
as a result of participation in the Reading Component, the 
reading grades of the students will show a statistically 
significant difference between the real post-test scores and 
the anticipated post-test scores. 

Subjects I All participants in the reading component. 

Method and Procedures! The appropriate level of the 
California Achievement Test, Heading subtest level 5 will be 
administered on a pre/post basis in September, I975 and May, 
1976. 

Analysis of Datai Data will be analyzed by the "Real 
(treatment) Post-test vs , Anticipated (vrithout treatment) 
Post-test design I utilizing a oorrelated **t"-test," 

In this report the actual post- test scores and pre- 
dicted post- test scores obtained on the California Achievement 
Tests, 1970 edition, (CAT-70) in Reading were analyzed. The 
predicted scores were derived from the. pre-test , scores on the 
subtests of the CAT-70. The "Historical Regression Design" 
compared an actual post-test score obtained subsequent to the 
students experience of the activity in the reading component 
With a post-test' score predicted from the students' achievement 
on the CAT-70 pre-test using the correlated "t" statistic. The 
predicted post-test score is a measure of what the student 
might be expected to achieve on the CAT-70 if no work or 
remedial help in reading were provided. 
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Evaluation Ob.ieotlve No, 2 •^To determine whether, 
as a result of participation in the corrective Mathematics 
Program, the mathematics grade of. the students will show a 
statistically significant difference between the real post- 
test score and the anticipated post-test score. 

Subjects I All participants in the mathematics 

con*oonent . 

Iiethod and procedures! The appropriate form of the 
California Achievement Test (CAT-70) mathematics sub-test level 
5 will be aO.mini^^tered on a pre/post basis in September 1975i 

and liay 1976 • 

Analysis of Datai In this report the actual post- 
test scores and predicted post-test scores obtained on the 
California Achievement Tests (GAT) in Ilathematics will be 
analyzed, utillzlne the correlated **t"-test/' 

Lhc predicted scores were derived fror. the prc-test 

Gcoren on the subtests of tho CAT-70. The "Kistorical Hecression 

Deci^^ii'^ compared an actual post- test score obtained subsequent 

to the stuaenl^::^ o::T:erience of the activity in the mathematics 

corTiponent v:ith a post- test score predicted from the students* 

achiovonont on the CAT-70 pre-tcsts, uslns tlie correlated "t" 

statistic. The predicted post- test score is a measure of what 

the student mieht be e:?:pected to achieve on the GAT-70 if no 

vorlz or remedial help in mathematics v?ere provided, 

Evaluation Cb^jective i:o. 3 "To detei^mine the extent 
to '.rhlch the pro::rain, as actually carried out, coincided with 
the program as described in the Project Proposal/' 

5i:: (6) on-site observations and visits determined 
;;hethcr discrepancies ezisted in the general implementation 
of tho proposed program, 

A memorandum dated September 12, 1975 specified modi- 
fications in the August 1975 CDD program's Ii>valuation Design. 
The modification replaced the 3,A.T. Instruiaentation* of the 
•Drecedivic; year V7ith the instrumentation specified above o 
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CHAPTEH III 
FINDINGS 

Diirms the 1975-76 academic year the College Discovery 
and Development centers at three senior high schools operated 
a proeran designed to improve the reading and mathematics 
performances of those participating high school youth who made 
up the target population. The decision had been made to use 
the 1970 edition of the California Achievement Tests, Level 5, 
in Heading and in Mathematics, for evaluating the effect of • 
the remedial and/or corrective programs. 

The CAT-70 represents one of a number of available 
General achievement batteries. Level 5 of this battery provides 
a measure of- general education achievement in tae high school 
academic curricula. The obtained scores on the Reading and 
Mathematics subtests can be used to determine the relative 
standing of the individvial student in the different curri- 
oular areas in comparison v.'lth a uniform normative sample. 
In addition the score scale can be used to view the student's 
pro£,Tess over time, vrithin grade (on a pre/post-test basis) 
as v;ell as from one grade to another. 

The GAT-70 is a siorvey test in that it indicates the 
ctudent's level of reading and mathematics achievement. As 
such it is to be distinguished from tests that are developed 
With the intent of diagnosing the causes of difficulties in 
reading or mathematics through an analysis of the student's 
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strengths and weaknesses in those respective areas. 
Achievement Data fles-ults 

In compliance with the modified evaluation design 
specifications and using either Ponn A or B, Level 5 of the 
CAT-70 in Heading and Llathematics , students were pre-tested 
in October, 1975 (as near as was possible to the September 1975 
date) and post- tested in Kay, 1976 (as specified). Those 
students tested vrere 10th, 11th, ai:d 12th graders at the three 
participating high schools. The CDD centers at the school chose 
either the Form A or Form B (its equivalent) to administer as 
its pre-test. The form chosen by the center was then admin- 
istered to all its participating students. The equivalent 
Form, A or B, which ever was appropriate was then used in 
obtaining the post- test scores. 

Tenth, 11th and 12th year students grade-equivalent 
scores in reading and mathematics were submitted by each of the 
schools. A computer analysis of the "Real (treatment) Post- 
test vs Anticipated (vjithout treatment) Post-test*' data was 
rim» A correlate t-ratio of the difference between the group 
predicted post-test means and the obtained post-test means 
was used to identify statistically significant findings in 
both the Heading and Mathematics performances. 

The MIR forms, see Appendix B, of this report contain 
the analyses of a comparison of the two sets of scores for 
both reading and for mathematics based on actual post- test' 
scores on the CAT-70 and predicted post- test scores. In accord 
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v/lth the FiiR requirements the evaluation design specifications 
are presented in terms of treatment duration (here either an 
8 month or ^ month Interval). 

Test result^ n the Heading Component were available 
for 55^ students. is nt of the total number 

-of-675^ students Who liad to ^ ..^--tesTTn^^e^l^i^rTe^s^^^ 

for a lack of post-test scores included truancy, discharges 
or insufficient information (see Appendix C) . 

Test results in the Mathematics Component were 
available for 376 students. This is 85.^5 per cent of the 
total nuriber of the H'ko students who had taken the pre- test 
in mathematics. Reasons for missins post- test scores included 
truancy, discharges, or insufficient information (see 
AppeMix C) , 

The entries for the 10th, 11th and 12th grades with 
a treatment interval of 8 months were based on the data from 
the three participating schools. However, those entries with 
a treatment interval of 4 months, are based on data that was 
available on a subgroup of the students in one of the schools. 
These students had experienced half the treatment time (l,e, one 
semester of remediation) as compared to those who had had the 
full treat^'-ent (i.e. U^o semesters of remediation) in either 
nathematics or readinc« The results, presented as separate 
grade entries, with testing dates appropriate for the treatment 
duration, were obtained using separate historical regression 
analyses (see MIR Forms, Tables IR, 2R, IM and 2M) . 
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TABLE IR 

Heading Achievement Gains in Standardized Testing 
College Discovery and Development Partlclpaiits 

(1975-76) 

Predicted Actual Leve3 
Treatment Pre-Test Post-Test Post-Test Value laf 
Grade Student Interval Score Score Score of Slgnlf . 
Group No . (mos...) (gr-.eq . -(gr .eg , ) isr.eq.) t IeJ 



TABLE 2R 

Average Monthly Heading Achievement Gains 
College Discovery and Development Participants 

(1975-76) 

Treatment Average 
Grade interval pre -Test Post-Test Absolute Monthly 
Group (Sch. Yr. ) (gr.eq.) (gr.eq.) Gain Gain 



10th 



0.8 7.0 8.0 1.0 1.25 

11th 0.8 7.8 8.8 1.0 1.25 

0.8 8.9 10.^ 1.5 1.87 



12th 



11th 0.4 8.5 9.7 1.2 3.00 

12th 0.4 9.5 11.0 1.5 3.75 



10 th 


2^9 


8 


7.0 


?.6 


8.0 


3.68 


.01 


11th 


167 


8 


7.8 


8.4 


8.8 


2.08 


.05 


12 th 


105 


8 


8.9 


9.4 


10.4 


4.26 


.01 


11th 


k 




8.5 


8.7 


9.7 


2.17 


n.s . 


12th 


29 


4 


9.5 


9.8 


11.0 


4.39 


.01 



TABLE III 



Mathematics Achievement Gains In Standardized Tes ting 
Gol?.ege Discovery and Development Participants 

(1975-76) 



Grade 
Group 


Student 
No. 


Treatment 
Interval 
(nos . ) 


Pre -Test 
Score 
(gr.eq .) 


Predicted 
Post-Test 
Score 


Ac tual 
Post-Test 
Score 
(gr.eQ J 


Value 

of 

t 


Level 
of 

Slgnlf. 

(?) 


10 th 


217 


8 


7 ,1 


■ 7.7 


8 .3 


5 


.01 


11th 


98 


8 


-> 


8.2 


8.8 


k.6l 


.01 


12 th 


29 


r\ 




0.3 


8.6 


1A5 


n.s . 


loth 


5 




8.0 


8.2 


8.1 


-0.^8 


n.s . 


11th 


26 




7.^ 


7.9 


8.4. - 


2.21 


.05 


12 th 


3> 




7.3 


7.9 


6.5 




.05 



TABLE 21.; 

Average Monthly Mathematics Achievement Gains 
Colle^^e Discovery and Development Participants 



(1975-76) 

Treatment Average - 

Grade Interval Pre-Test Post-Test Absolute Monthly 

Group (Soh. Yr . ) (gr.eq . ) (f^r .eg . ) Gain Gain 

10th 0,8 7.1 8.3 1.2 1.50 

11th 0.0 7.0 8.8 1,0 1.25 

12th 0.8 7.9 8.6 ,0.7 0.87 



loth 


O.ir 


- 8.0 


8.1 


0,1 , 


0.25 


11th 


0.^ 


7.^ 


8.4 


1 .0 


2.50 


12th 


0.4 


7.3 


6.5 


-0.8 


-2.00 



The samples entered in the if month treatment Interval, 



in total, constitute a unique subset that occurred In but one 
of the schools and comprised, a subgroup within that school. 
These groups experienced half the treatment Interval specified 
m the evaluation design. Three of the sa^nples had less thaii 
10 students, belovi that necessary, to meet-e::is ting statistical 
criteria. In addition, their qualifications for admission to 
the sample? - - : completely known. i\..r these reasons one 
is 'cautioiTi^v. wgalnst comparing the obtained results with chance 
expectations . 



Separate historical regression analyses were performed 
on the data for each of the grade levels for both the Reading 
and Hathematics components. Prom, a consideration of the 
findings in Tables IH and 2R it can be seen that those groups 
With an 8 month treatment interval had, at e&ah grade level, 
actual nean post- test reading achievement s©r.;-3 gains that 
were, s ta-astically , signif icantly greater --feh obtained with 
the predicted post- test mean scores. 

A similar consideration of Tables l.: and 2M shows 
that the actual mean post-test I-iathematics score gains for 10th 
and 11th grade students ivith 8 months of treatment were also, 
statistically, significantly greater than would have obtained 
With predicted mean post- test scores..^ in the analysis of the 
12th grade, the actual meait post-test score was higher than the 
predicted -^M-t-test, but the difference fell short of achieving 
the ,05 1^1^ of significance. These differences indicated 



that the objecrlves of the prograra associated with Increasing 
mean reading and mathematics scores had been met. 

The analyses of the data for the k months treatment 
groups provides results that underscore their uniqueness and 
limited interpretablllty. In Tables IR and 2H the mean pre- 
test scores (grade equivalents) of these groups^ for the B<^ad- 
ing Component, are consistently higher than for those groups 
v;ho had the longer (8 months) treatment Interval. However, 
for the Katheiaatlcs Ccioonent, see Table 111 and 2K^the mean 
pre-1.est scores of the k month groups occu3?%*ed in descending 
order (10th, 11th and 12 grades). This sequence contrasted 
v/ith those scores of the 3 month group which occurred in 
ascending order* The most obrlous evidence of uniqueness 
occurs in Tab! T-i and 21-: where the average monthly gains range 
from -2.00 to -f:' ^73 la range of 5.75)- This constrasts with 
the range of tr-^ £. ;ucnth group, see Tables 2R and 21.:, vJhich 
was 0.8? to 1.37 ^n^ie of 1.00). 

The T>r'^P;|'l^^r^ coordinator, among others, has expressed 
concern about standardized achievement instruments used 

each year as mil ts with th« changes from year to year. An 
cr.phasis on pr - ■ evaluation could occzor' at some expense to 
the individual . ^^;i-^nt*s and teacher's perXoCTiance . 

The .jne of the CAT-70 as well as of other standardized 
tests could be mciir^ full;' explored. By providing articulated 
normative evaluation af reading and arithmetic achievement In 
graded from 9-12 tests can be used as an aid in planning 



curriculum and evaluation programs . Such planning could further 
emphasise the continuity of student growth at each £rade level 
m terras of the basic skills and the shared knowledge • 

The more appropriate use of the survey test approach 
is to provide^ usinf' single composite scores, a measure of the 
effectiveness of programjaing throiigh an analysis of the general 
level ".of the student's achievement in reading or mathematics. 
It is the criterion-referenced approach that has emerged as 
providin^c^ a more appropriate measurement of a program's impact 
on an individual student. However, the combination of these two 
approaches is necessary in order to provide the relevant infor- 
mation for educational decisions at the several levels. 

J. 

The feasibility of criterion-referenced measures in 
providing narrowly focused diagnostic and prescriptive infor- 
mation through individual student measurement by objectives has 
been discussed with the project staff and liason. 
Adequacy of Materials and Facilities 

The classrooms at the three participating schools had 
ampl'e amounts of ..ins tructional materials due in part to the on- 
going nature of the program and in part to the care with which 
the materials are managed. Supervised use and. storage permit 
staff and students to knovr what is available and where it is 
located. 

Students, teachers and educational assistants demon- 
strated" ready familiarity with the available materials and with 
their uses, 'in addition, teacher-oreated materials at some of 
the sites were available and suited to instructional purposes. 
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College consultants working w,th the coordinators, 
chairmen and teachers helped provide additional materials 
either directly or Indirectly by Introducing new ideas. The 
consultants demonstrated skill and understanding In developing 
opporttmltles for additional subject related experiences , 
supplementary to available remedial or corrective materials. 

The available materials Included Innovative uses of 
Words and arl thematic concepts using a game format. In tl 
classroom there v;as ready access to the generally available 
reading and, mathematics "kits," "series," "systems," as well 
as, paper backs and In some classes magazines and newspapers, 

-Cin the occBTSlon of one slte-vlslt It was evident 
that a need still existed to further explore the use of home 
television as an additional CDD resource, A program telecast 
at that time had combined a visual and auditory sequenced des- 
cription of the systeiss of the htunaji body. The topic parallelled 
subject matter then being studied by some of the CDD students. 
In this example the latest In Instrumentation and equipment 
provided a resource antedating ^materials generally av^allable 
to the current school prograim. 

It IS obvious that effective coordination would be 
required^ to Integrate and pace program and classroom content. 
However, contact between CDD and: network staff could effect 
mutually beneficial exchanges. By relating vi)cabulary, con- 
cepts and principles to the content of television programming 
the 22S3„ staffs' remediation and corrective efforts would have 



additional relevance. In addition, it would give guidance to 
students' prosram selection. 

Developments in college text-book publications is also 
pertinent in terms of additional resource materials. This is 
because there has been a response on the part of publishers to 
Simplify college text-boolcs to meet the special needs of some 
readers. Through the use of "readability forr -in" ord length 
and sentence s^tructure are analyzed and the-^*e:ct books are pre- 
pared in keepinE with the G;tud.ents' demonstrated capabilities, 
Selective use of such books for the hish school level could 
upgrade the educational experience of the GDD students. 

The physical facilities in the three participating 
schools v;ere adequate, Cffice space for the coordinators and 
?.dviGors -.^as cramped but did not interfere with the performance 
of their duties. Small jroup instruction was generally carried 
out in re'z^ular school class-rooms. These rooms were, for the 
most part, well lighted anc^airy. The amount of materials 
present in the classrooms appears to tax existing storage space 
capacity, 

.The students were most often observed sitting in rows 
attending to their individualized tasks. Teachers or educational 
assistants provided individual assistance usually at the student's 
desk.. In a few classrooms teachers were observed in group 
Instruction, Typically the desks in the classrooms v/ere 
arranged in rows, A few classrooms with movable desks had semi- 
circle arran^snents with students engaged in either individually 
pursued tasks or teacher-gi'oup instruction, 

20 
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otaff Training Conferences 

Staff training sessions are attended by teachers, 
coiinselors, coordinators, educational assistants and the 
Project Coordinator, The availability of colle^re consul ta/^ts 
for these staff training; .leGsions provides an oppoo. ^cinlty for 
a meaningful exchange betvjeen the staff at the respective 
Institutions . 

The regulgirlty of CTch sessions^ their seminar format, 
the quality of the exchanges :and the quaIS:f Icatlons of the 
participants point to the opportunity for a more formal arrange- 
ment. A survey of the staffs' concerns and Inputs related to 
existing disciplines provide the basis for furtherlne relations 
bet^jeen the Institutions leading to empirical grounding of 
various d IscipHne-related- theoretical constructs. 

As currently carried out the project effectively 
serviced the needs of the target population. This conclusion 
is Indicated by the statistically significant improvement in 
both the reading and mathematics performances of the students 
at each of the grade levels (except grade 12. in the Mathematics 
Component vJhere Improvement occured but did not reach statistical 
slcniflcarice ) . The statistically significant 'Mndings along 
vJith the Site-Visit observations and interviews clearly support 
the viev: that the current methods, materials and techniques 
used in improvinfi; reading and mathematic performances are 
responsible for the success of the project. 
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laplemen tation of Previous Reoomendatlons 

The 197^ ' -nD report 3/E ^^0^ q6io madr specific 
recoiruncndatlonc, ..-i, a final one uiie seventh), that the 

prosraM be recycled. The decree of implementation of each is 
commented upon as follows: ^. 

1. "Adequate secretarial help should be provided," 
This recommendation was followed, but mid-year 

excessins caused the loss of some secretarial services. 

2. "CDD remedial class registers should not exceed 
10 students." 

Budgetary restrictions and adequacy of teaching per- 
sonnel to handle registers of 15 - 20 students are reasons this' 
recommendation vras not implemented. 

3. "Mequate office space should be provided at each 

center." 

Space is limited. 

^. "Continuance of on-going inservice training, 
expecially for new personnel, is recommended." 

Attendance at training sessions showed this recommenda- 
tion had been fully implemented. 

5. "Pundinr; approval by City and State agencies must 
be secured earlier so th^.t .all aspects of the procran can b^gin 
In 3cptej-iber . " 

Budgetary procedures lie outside of the authority of 
the prograjn Coordinator and her staff, s:a that this recommenda- 
tion could not be implemented. 



22 



6, "Heappralsal of tutorial program inclusion is 
recommended.** 

The Field Coordinator (C.U.N.Y.) has made strenuous 
efforts in this direction. College student tutors from C.U.N.Y., 
College Work Study Programp as well as additional tutors 
obtained throvigh other innovative approaches provided tutoring 
on a limited scale. 



23 



CHAPT3R IV 

SWIIIARY OP I-iAJOR PI^IDINGS, COHCLUSIOKS AI>ID 
RSCOMIIENDATIONS 

Stunmary of Ha.^or Flndin|ifS 

On the basis of an historical regression analysis 
of reading and mathematics data for each of three grade levels 
(10th, 11th and 12th), at three ODD schools, students' per- 
formances were fo^ind to have improved more than were predicted 
on the basis of pre-test data. Statis tioally significant 
differences between the predicted post-test and actual post- 
test scores were found. These findings held at each of the 
three grade levels in reading and at the 10th and 11th grade 
levels ,in mathematics, m the analysis of the 12th grade the 
actual mean post- test mathematics score was higher than the 
predicted, but the difference did not reach a .05 level of 
Significance, 

Prom Site-visit observations and interviews it was 
evident that the students' and the staffs' knowledgeable 
use of remediation and/or corrective techniques and materials 
in adequate facilities supported the statistical findings. 
Additional resources available to CDri''s tudents , and for extend- 
ing the remediation and corrective functions were indicated. 

Attendance at staff training sessions showed active 
involvement and exchange between qualified practionners . 
These exchanges provide opportunity for professional guidance 
as well as development. 
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Conclusion 

Data suinmarized above along with the site-vlsit 
observations and interviews justify the conclusion of effective- 
ness of this Supplementary educational program • 
Recommendations 

On the basis of the significance of reading and 
mathematics achievement data presented in the findings; the 
overall adequacy of materials and facilities in delivering the 
services to the targei; population, and the dedication of the 
staff. It is recommended that the program be recycled for the 
197^*^77 school year. Additionally, some specific recommendations 
follow I 

1 • Dlap^nostlc Procedures ! 

In recognition of the advances of "criterion referenced 
testing" In diagnosing educational deficiencies In reading and 
mathematics, and in deriving educational prescriptions for 
students therefrom. It is recommended that the ODD Program explore 
on a pilot basis for the ±976^77 year, certain CRT materials. 
" a. This approach will provide continuing process evaluation of 
selected skills to show deficiencies occurring more frequently, 
on a pilot basis. This might serve as a model for all schools 
In the program. In the following funded year. 
2 . Ins true tl onal Materials i 

Some of the reading and mathematics materials In use 
m the remedial classes have been found at a content level, 
below the maturity level of some of the student population* 
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It IS recommended, therefore, that greater exposure to Ideas 
and principles found in more advanced reading material be 
encouraged. Among specific approaches suggested are i 

a. Texts that use simplified language to convey ideas and 
principles found in more advanced reading material to be 
introduced ^ 

b. "Hands on" experiences that are relevant to the content of 
the materials (e.g. mathematics laboratory materials and, in 
reading role play experiences) be used. 

c. T.V. programs as available that relate directly to reading/ 
mathematical assignments, be coordinated x^rlth the instructional 
materials , 

3 . Personnel and Facilities t 

It is recommended that on-site staff training Include 
graduate level courses to be offered by the cooperating City 
University Division to further: 

a. ICnoxTledge of newer development In tests and measurements 
such as criterion referenced testing, 

b. toowledge of process ^(contiriuQUs monitoring) evaluation. 

c. ICnovledge of development in educational technology leading 
to more effective use:s of alternative instructional options, 

^ • Interaction and Articulation i 

It is recommended that the possibility of a more 
formal structuring of ODD and G.U.K.Y. staff interactions to 
provide increased articulation between the high school and 
college curricula, with respect to Title I content, be considered. 
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Appendix A 
College Discovery and Development 
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B/E #09-69610 

Component Codes Activity Code Objective Code 

6O8I6OO 720 801 

6091600 720 801 

PROGRAM ABSTRACT 

The purpose of thir? program was to provide small 
group and Individualized instruction In components of reading 
and mathematics using diagnostic and prescriptive techniques. 
Approximately 800 students, grades 10-12, were served In three 
New York City High Schools. 

- The project objectives were that participants show 

statistically significant differences between the real post- 
test scores ajtid the anticipated post-test scores, as measured 
by the California Achievement Tests, in reading and mathe- 
matics. An additional objective was to determine the extent 
to which the program met the specifications of the project 
proposal . 

The cognitive objectives above were achieved as 
demonstrated by the correlated t-ratios which identify signi- 
ficant results supporting the above objectives. On-site 
observations and visits attested to the general implementation 
of the proposed program. 

Achievement of the objectives of the program provides 
support for the activities utilized in the project. It is 
recommended that the program be recycled. The detailed 
recommendations appear in the narrative. 
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Table 9 Historical Regression Design (6-step Formula) for reporting norm referenced achievement tests 

, in Reading and Mathematics, 

COLLEGE DISGO'/riY U moPlH^IiT _ B/E Function #0969610 

In the Table below, enter the requested assessment infomation about the tests used to evaluate the 
effectiveness of major project component/activities in achieving Qognitive objectives. This form re- 
quires means obtained from scores in the form of grade equivalent units as processed by the 6-step 
formula. (see District Evaluator's Handbook of Selected Evaluation Procedures , 1974, p. 29-31) Be- 
fore Mfflpleting this table, read all footnotes. Attach additional sheets if necessary. 



Component 
Code 



Activity 
Code 



Test 
Used 



Form 



Pre Post 



Level 



Pre 



Post 



Total 



Group 
IDjy 



Number 
Tested 



m 

(8) 



Pretest 



Dat^ Mean 



Predicted 
Posttest 
Mean 



Actual 
Posttest 



Date Mean 



Obtained 
Value 
of t 



81 



0 



? 



2 



0 



A-B 



34 



296 



loth 



^9 



7.0 



?.6 



5/76 8.0 



.3,68** 



202 



11th 



16? 



12 



nth 



m 

2773 



7.8 



8,4 



5/7<i 8.8 



2.08^:- 



m 

(8) 



8.5 



8.7 



5/76 9.? 



2.17 n.s, 



I 




125 



12th 



105 



m 



8.9' 



9.4 



5/70 10.4 



4.26*<f 



4o 



12th 



29 



9.5 



9.8 



5/70 11.0 



4,39'"-" 



2 



0 p/iI-?D 

r 



A-B 



B-A 



254 



loth 



217 



i 




10th 



7.7 



5/70 8.3 



5.48« 



116 



nth 



93 



31 



nth 



26 



(4) 

m 

(8) 
(4) 



7.3' 



8,2 



2/76 8,1 



-0,48 n.s, 



8.2 



5/75 3.8 



4,61** 



7.4 



7.9 



2/7^1 8,4 



2,21^^ 



^^^3I^-p-'To! 

1/ Identify the test used and year of publication (MAT-58, CAT-70, etc.). •"'Sisnif, p ^ ,05 
2/ Total number of participants in the activity. n.s, lio iiignif. Diff, 
3/ Identify the participaiits by- specific grade level (e.g., grade 3, grade 5), Where several grades arc com- 
bined, enter the 4tli and 5th digits of the component code, 

y Number of pupils for whom both pre and post test data are provided. 

( T The number under Pretest Date indicates the number of months of program treatment.) 
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Table 9 Hlaeorrcal Refiresslon Design (6-step Foraula) for reporting norm reference achievement tests 

in Reading and Mathematics. ^^^^^^ ^q^^^^^q 

COLLEGE DISSM: AND DMLOPllEilT 

In the Table be'lottr,, eater ty^m^imi^ assessment InforfiMon abniit the teste used to evaluate the 
ef fectbenefs : tejor project ?:tii^«nt/act£vitie8 Id wtoing ^^ognitiva, ob jectivifS.. This form re- 
quires mean^ 'S^Kii ned from scores the forw oE grade equijitolent units as processed by the 6-step 
fonnula>(s6:r!,:.-: let Evaluator's^iiiaook ox Selectesi EvakationETOcedures , 1974, p. 29-31) Be- 
fore coffiplfitJig *us table, read aE. footnotes, Attaclt additional sheets if necessary. 



Component 
Code 



1 

I 



0 



.■?%ity 
'Ciflde , 



T 



1 



Test 
Used 



Form 



Pre 



± 



Post 



Level 



Pre 



I 



Post 



Total 
UL 



29 



S 1 



12th 



Numbsai 

lesEgBj Pretest 
4/ Lfete'fMean 

Wo 

■ 7.9 



(B) 
57? 



7.3 



S.3 



7*9 



Actual 
Posttest 



Date Mean 



5/?{. 8.6 



5/?^' 6.5 



Obtained 
Value 
of t 



1/ 

2/ 
ll 



Identify the test used and year of publication (MAT-58, CAT-70, etc.). ^^f^nif > M 'J^ 
Total number of participants in the activity. ^'^ • ^lenU . Uin , 

Identify the participants by specific grade level (e.g., grade 3, grade 5). Where several grades are cobs- 
bined; enter the 4th and 5th digits of the component code. 
Number: or pupils for whom both pre and post teat data are provided,' ^ 



( T The number uwier Pretest Date Indicates the number of months ofnonths of program treatment,). 
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O FFICE or EDUCA'flOML EVALUATION " » LOSS M 
(attach to mmm) Funnloti I^^M'(>9SlO 



In thla tablfi ontcr nil Datn to Infomulon. Dctwcon tU ' f and tirli form, all partlclpanfg In cnch activity 
rauBt be accounted fot. Tlip component and activity codes u8ed Ir. npktioti of the MIR should be uRcd hnre so th8t 
the two tables natch. See doflnltlona bdw tnbU for further li; :rtct:iona. 



Component 
Code 



08 



i 



/ 



7 



Activity 

Code 



2*^ 0 




(1) 

Group 
LD. 



10 



11 



11 



12 



(2)! (.1) 



Test 
Used 



12 



Totfl 
N 



296 



202 



12 



125 




CO 

Nimbnr 

Tested/ 

Analyzed 



2kS 



167 



105 



29 



(5) 

part lei anfts 
Wot Tf 'A^!'!/ 
Ana'lyag4 



N 



^7 



35 



20 



11 



Transfer (15) Abs, (6) 
Tnsal'f I6l5nt I hroMtlon (:9) 



16.0 



27.5 



(fO 

Reasons Wliy Students Were Hot Tested, 
Or If Tested, Here Not Analyzed 



Truanoy (9) msch. (^1 ^ ~~ 
Traasfer (2) Abs, (4) :]3itern ( 1) 
Ueceasea (1) ' ~ 
Insufficient Informffto {Ik) 



Dlsich. (1) 



InsifTiclent Infonnatlon (7) 

Truancy (1) Transfer (3) " 
Abs. (1) Grad. (1) 
Insulllclent Information (1^^)' 



Insufficient TnfQCTnatlQ^ (11) 



NuHiber 



38 



Ik 



6 



(1) Identify the partlclpnnta by specific grade level (e.g., grade 3, grade 9), W.iorc several grafes are combined, 

• «nter the last, two digits of the component code. 

(2) , Identify the teat used and year of pubScatlon (MAT-7fl, SDAT-7A, Houghton Hlfflln (IPMS) Level l etc.) 

(3) Nynibet of participants In sJie activity, 

(4) Hwbcr of participants included In the pre and posttest calcnlatlons. 

(5) Nunber and percent of partlclpantB not tested and/or not analyzed. 

,(6) Specify all roasona wliy students were not tested and/or analysed. If any further docmntatlon Is available, 
pleflsc attach to thla form. If further (Jpace Is needed to specify and explain data loss, attach additional 
pflgM to thla form. 

(7) For filch reason spec-lEted, provide a separate number count. 



OF I CE OFMKf.IOllAL|yAU! MlON vDATAJ-OgyORM 
(ntmrli t P-iiUlniATlVE) ' Fiiiict ion fB/K ;/09-696lO 



In l;lvl* 1;(iI)1p .M,|.or 'ilj pnin .'firmiwu Ion. Ilotwpon (Jio Hilt nml lliln forni, nl[ |.,ir! |cli.,-iiii n l,i miIi a-Kvll v ' 
mn be ncpiunlpil lor. Tiic coinpononi ftu! j]u;ftvlLy coug.-; u9ti<I [n couiplptlon of the H[R ghouW lio unod hrip so rlmt 
tfi* t«o tfllslH mat -ii. Sr^ (Irfliiitlnn.n i^i* f/iMc for further (natnictloti.q. 





Ootilpo 
CchI 


c 

■"4—1 ■ 


Ac 

( 


h 

;iHl 


1 


(1) 

(ir<ni|) 
LIl. 


(?.) 

Tr.it 


0) 


tliiiiihf'r 
Anfllyjod 


(5 

Not 1 
__Anal 
N 


) 

l.pfiirfi 
o/if.od/ 
yzed 


('') 

KfaaoiiR Wliy .StiidnntR Mnc No( 'IV/Krd, 
Or If Toflted, Hero Not Annly/.cil 




■;| 






lit- 


4 


ii 

i 

1 

• Ii' 






217 






"Truancy ('/) UlSch. t^] ■ 




}M {2) ■• - 


— 29 — 

0 




10 








1 


16,6 


Insufficient Infcmaatian (1) 


1 




■ 


is 








I 




11. 






116 


98 


18 




Truancy m Msch. (7^^ 




Transfer (:2) Mem (t) 
Insufficient infannatiCEi. (8) 
















n. 






31 


26. 


5 


16..1 




■ 

■ 


Abs, (1) 

.Insufficient jtoEonnatlsn 


~k : 






7" 














29 


2? 


2 




Truancy (1) 


1 ; 




Insufficient Infonaatiott (1) 


1 



(1) Identify the|8ictkl]mnta if 'spoclfk grade levd (e,g,, grode 3, grfide 9). Wlicro sewail Rrfldea are comhlnod, J 

enter the SMt Cucr diglte of the eomponout coi^^^^^ ; J 

(^) Identtfy theamut used ait7Garnfr;3«d.llcflt(on {MAT-70, sm-li, Houghton Mifflin (ITMS) Lovel i Dtc) I 
(3) Nimber of ptsliHpflnts |n ilG flcL'^^i^^^^^ 

' (A) Hinbor of i^sdcl))*!!^ luaoded ix^Mt pre find posttest caloiations. 

, (5) Hunibcr ««d:f!irtenL ol p9rtMpi«j»w«: mtvA nndfor not flw%Eed.. I 

(6) Spccirf 'Bill f pflnMw? why BbBgenia »eBg not tested and/or flnfllyTrefd, If Any further docunteufeatlon! Is nvflllnlife, | 

pleweflffiwdiitS!© this form., ,|f liiiiither space k needed ;to 8!pecify and explain data Jiro, 'flti»ch flddltlira^^ v| 

. '^IMiglVltPlSlSl^iKni.. .:.';| 

(f) FoKMd^ pmmtaiecilkig piawlte ff^^ ninnhcr cniint. 's 



OITOC Ejr EDIICA TM BAUOT^ ■ LOSS F01111 ' 
(atl/irli to nARiiMm) Functtoiii B/E | Q9-69610 

In thin tflhlo o„tnr nil MA \m l„fon,m:loii. llotwron tlin Hill and tills forni, flU p^irtlrlpanL^ In rnrl, nn fvltv ' 
must be nccountPa for. Tl.o co.ponr„i: nn,l Activity co,Ios usdJ In coniplctlon of tl.c HIR should I.e mA Iiorp so thnt ' 
the two tablfiD match. Soe dpflnltlon.-i bolow tnble ftr ferther Instructions. 



Component 
Code 



6091 



60 



Activity 
Code 



(I) 

Orouj) 
l.I). 



12 



(2) 
Tost 
ILird 



0) 

Tntfll 

1 



CO 

Himbor 
Tcgtfidi/ 



P{»Ttlclpnnt8 
Not TRfltod'/ 
_^n£h_red__ 



7. 



(0) 

RMflonfl Wliy StiidontB Wpvo Not 'IVntod, 
Or If Tofltcd, Worn Not An/ilyzpd 



Insufficient Information (1) 



NuiiiI)or 



(1) Identify the pnrtlclpnnte% flpn.ciat gp.* ^^„ :^&m,i^nie 9). Wlioro several grfldea ate combined. 

enter the last two dli^s of liie^ t^^ 

(2) Identify the toat used fln^^ycBr:aff ^ifeattlom^afM SI)A«,||mig^^^^^ (IPHS) Level I etc) 

(3) Htmber of participants In t!ic Bctltv% 

(A) NiwlKJr of participants Iraliuded In * 

(5) Number antl percent of f attic Ipontfi mt tsintd miktmi. analyied. 

(6) Specify all rraijonfl wiiy Biaidenta were 1^^ If flny further documentation Is nvallnblp, 

plcfl8c attach to thla Brra. If Curler npfloe fe wled to ipedfy und explain data Ions, attach additional 
[■gfll to this form. 

(7) For eich reajon apeclfled, provile « 



